DOCOBEIT IBSOHB 



BD 206 067 

AtiTHOR . 



IHSTITOTIOH 

SPONS AGENCY 
fPOB DATE 

NOTE 



EORS PSICB 
DESCRIPTORS 



IDENTIFIERS 



BA 013 BOH 

# " 

^Sqalres, David A« • . 

^In'prOTlng Policy Throagh Research: A Case Studf of 
the Revision of Delaware's Prograa Standards for 
School iaproveienti 

Research for Better Schools, Inc., Philadelplriav 
Pa* ' 

National Inst, of Education (BD) , Hashington, 0«C« 
Apr 81 

«00-8d-0106' 

29p«;. Paper presented at the Annual Meeting of the 
Anerlcan Educational Research Association. (Los 
Angeles, CA, April 13^17, 1981K Figures and 
appendices may reproduce poorly due *i:o stall print of 
original document* / 

HP01/PC02 Plus Postage. 

^Idainistrator Attitudes; Edujcational AdBlnistration; 
Educational iBprovenent; High Schools; ^Influences; 
Interviews; ♦Poligfy Ponatlon; Progtan Effectiveness; 
Standards; estate Standards 
Delaware; *Knowledge Otilization 



ABSTRACT 

An interview study in Delaware ^gabher^^d information 
about educational adninislbrators* perceptions of effective high 
schools^ and existing statewide standards for effective schools. This 
report describes the design and analysis of- this study and 
demonstrates' how- th& resulting information was used to reformulate^' 
the staters, policy and program for school impro.veaent.^ The/paper 
documents the utility of Kfiott and Hildavslcy's seven ^proposed 
standards as a framec?or)c for assessing a successful knowledge 
utilization activity, in conclusion, the p^per argues * that «t he liigh 
inpact of the interview' study on policy revision was due in part to 
the identification of consensus among groups of educational 
administrators and to the provision of a systematic ^research^based 
way to bring the linguistic and conceptual frameworks of the 
e3ucatlonal administrators to bear on the problem of revising the 
school improvement policy. It is also suggested that Knott and 
wlldavsky*s standards might be useful for both planning and 
documenting knowledge utilization activities directed toward ^policy * 
revision., (Author/PGD) 
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♦ . Abstract 
This paper presents a case study which? 1) describes the design and 
analysis of an Interview study to gather Information about Delaware educa- 
tlonal administrators' perceptions of' effective high schools and the existing 
Statewide standards for effective schools, and 2) demonstrates how that 
information was used' to, reformulate the state's policy and .program for 
schdol improvement. The paper documents the utility of Knott and Wlldavsky's 
standards as a framework for assessing a successful knowledge utilization 
activity. The paper concludes by suggesting' that the high Impact of the 
interview ^tudy on policy revision was due in part to identifying consensus 
among groups of educational administrators and to providing a systematic 
research-based way to bring the -language and conceptual frameworks of the I 
educational administrators to bear on the problem of revising the school 
improvement policy. It is also suggested that Rnott and Wlldavsky's standards 
might be useful for both planning, and documenting knowledge utilization 
activities directed toward policy revision. *' * . " 
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Introduction ) * 



Goal-Directed Performance-Based 'Instruction (GDPBI) plan is Delaware 
Department of Public Instruction's (DPI) response to the m^imum competency 
and accountability concerns of the public. This state-wide plan Includes 
standards for Delaware Schools K-12 which are a set of criteria for ef fee- 
tive schools. In addition, through aNionitoring process, state department • 
personnel helps local school staff assess ^ their .schools *accor4ing to the 
standards, and plan ways to improve. The state standards for atchools 
developed out of six case studies of elementary schools — three high 
achieving and three low achieving — both groups having eimilar SES student 
intake (Spartz, ,et al., 1977). The six case studies suggested the initial 
-^•content for the standards. During the first year of implementation (1979) , 
the experience of DPI monitoring teams suggested that the standards needed 
to be revised in order to address the diffgtences. between elementary and ' ' 
secondary schools. As part of the revision process, an interview study 
was designed to gather administrators* perceptions of existing standards, 
and characteristics of effective high schools. " 

: ^ The first part of the paper describes the design and results of the 
interview study. The second part of the paper uses Knott .and Wildavsky's (1980) 
seven standards of research utilization to demonstrate the impact that the 
interview study had on state policy and suggests that the standards might 
be useful in planning knowledge utilisation activities which would effect 

polity. * V ^ " " ' / ^ 



The lytervlev Study * . * 

The Purpose of the Interview Study ^ < 

The major purpose of the interview study was^' to have secondary school 
principals selected superintendents and central office perspnnel, and 
DPI Staff give their input and recommendations for changing the existing 
standards to reflect their perceptions of an effective high school. 

The study specifically sought answers to four questions: 

# What are the characteristics of an effective high school? 

♦ 

• .What is the relative importance of the existiftg standards for 
Delaware schools? 

Is there congruence ambng and between' the various data sets generated 
" by the first two questions and the three groups of administrators' 
which were interviewed? 

m What does the data analysis suggest for revising policy about the 
standards? 

Data Collection Process ' j * 

; ^ - 

For the. interview study, all high school principals in Delaware (26).; _ 
representatives of all but one central office (16); and stat^ department" ^ 
subject area supervisors (8), participated In individual, two^hour interviews. 
During the interviews, participants yer-e asked to: 1) describCo the charac- 
terlstlcs of an effective high school, 2) rank the " seVfiifteen existing progfain 
standards for effective schools according to their Importance as Indicating , 
areas for school improvement, and 3) for the five top ranged standards, crltlq 
the indicators called components employed under those standards. 



In order to critique the components, the interviewees were given two 
pennies /:or each component. They could then place as many pennies on each 
componepc as they felt were warranted by the importance the component had 
for indicating the effectiveness of the standard. The interviewees were 
also asked about changes which would make the components better indicators 
of an effective school. 



.Below Is an example of one standard and its components* 



Figure 1. 



txwpl* ^of A Sund«tti and lc« CoapOMoU 

* • «»• * 

STAKDAM) X ^« achooX has a trarktnt atattaent of phtloaophy vhlch la 
acco«pant*d by achool eoa^U an^ focuaea on the acada of atudcnta* loth 
tha philosophy and fo^Xa are covpatibla vtth tha ova rail educational 
phlloaophy and poticleit of the achool dlatricta* ' 

" ^"^ COffONENTS OniHE STAKUARO ' 

- ' * J 

A* Tha achool h%» a vrittan atataa»nt on philoaophy Accofipaoied by 
achool foalot 

i* Tha awhool philoaophy and goal% ara ravlawtd by tha #ntira profaa* 
atonal ataf f and r«viacd, if aacaaaary, prior to October I of'OAch 
•chool year* * 



C* A oeeds aaaaaaMnt of pupil population haa beta done vlthin tha paat 
tifo yoara* 



0. Tho ttaada aaaaaaaMnt includea: 

- data en atr4«nt needa « 

- current atatua of atudant population 

- ttm dif farance bacveen current atudant atatua and ato^'tnt ateda 
• - ^^riority vank of ecudant neede 

y^goAla to aeat pcibrity ntcda 

K. 'rrioriry 



ioriry toals ara identified and focua on tha physical, aociel and 
ictoUactual needa of atudanta*^ 

o > » 

- ^ The philoaophy and toata ara disaaainated to all ataff i:eabera, 

paren^a, and tha coaaui^ty prior to October 13 of each school year* 

0» Tha priority t^la ara not in conflict irith tha written to*Xa and 
policies of the achool district. 



Interviewers were trained In^ methods used in open-ended interview 

0 

situations to elicit and record responses for the first part of the Inter- 
view, and the structure and format of the second part of the interview. 
All interviewers had had experj.ence in intervlewingv- They were matched to 



the Interviewees, on the basis of compatability, by the State Director of 
Instruction to insure candid responses. The Interviewers practiced inter- 
viewing their collea&uea at DPI. Before conducting the actual interviews, 
a letter was sent from DPI to all participants telling the purpose of the 



* < 



. interviews and' giying advance «dtice th^tt eaeh would be asked to' falk about ' 
* , • ^ 

the characteristics of an effective high school* 

Results 

.To answer the two questions of the study, "What are the characteristics 
of- effective schools?" and "What is the relative importance of the existing 
standards?"' two sets of data were gathered. The' first set consisted of thfe 
^ notes of administrators ' responses £^ the first question. The second set • 
consisted of the results of administrators ranking the existing steandards. 

Administrators ' Perceptions of the Characteristics of Effective Schools . 
Puting the first. part of the interview, respondents were asked, "What, §re' 
the charact^eristics of an effective school?" The. data consisted of notes 
taken during the interviews. These notes from individual interviews were 
divided into statements. Redundant statements across all interviews ware ' 

eliminated. ^ Thus, the interviews yielded 111 statements about effective' 

» ■ * 

schools. (See Appendi^ for^the 111 statements.) A more detailed explanation 
and rationale for this procedure can be found in Squires, 1978, 1981;^ 
Colaizzi, 1979;. and Krippendorf f , 1980. 

The 111 statements were grouped by one. RBS staff member and' one DPI 
#taff member tq determine the general areas suggested by the specific state- 
ments. While there were many different vays the statements could be grouped, 
the general categories which had the' most stability over a number of different 
attempts at grouping were: school focus, curriculum, leadership, "and school 
climate. 

The stability of the four categories were tested when 12 instructional 
division staff of the state department met and sorted- the 111 statements into 
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t^elr own categories. Consensus wds reached about -the adequacy of the sug- 
gested categories » thus .usi^^g the prof "sssional ^experience of DPI supervisors 
to confirm the interview study/ s results* This 'sorting task also provided 

way for different DPI staff to< share. their own ideas and/or conceptual 
maps wj.th others in the * Instructional ,Divisipn« A similar activity, was . ^ 

• » • m 

completed by the 9-^12 Principals Advisory Councils The number of existing 
standards (17) then could be reduced under the f our, headingls. which were found 
iti the Intenriew- studv/ • Such a reduction would make the statements easier 

to remember and* use terms which have meaning tcf educational administrators. 

« • <» * 

The reduction possibility, is tested further (sect p. 11, Figure 4). 

Administrators* Ranking of ^Existing Standards ; c Tlxfe second set of 
'* * ^ " \ ^ 

data gattiered about administrators*! perceptions bf cliaracteristics of • 

cf f ectiviE? schbal^ was obtalnecJ by' asking the administrators to rank the 
existing standards for effective schools. Figure 2 summarizes how princi- 
pals, central offiTce ataff and DPI supervisors ranked the existing^ standards; 
an average ranking for all interviews Is also, included. Tne averAge ranking 
for all Interviewees waB obtained by adding up all interviewees'* rsfak 
assignments for^eacK^ standard, then dividing the total by the number oi 
interviews. The rank order of the standards for each group (principals, 
central office representatives, DPI supervisors) was determined in the same 
way. 

Determining the Congruence of the Data Sets and Defining Implications ' 
for Policy Revision . • . ^ - 

In this section, the two sets of ddta (the open-ended interviews, anrf , 

tliie rankings of existing standards) are compared to determine their similarities 
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Figure *2 



^!rtncl|»4U ranked thtw" 
of 17 In ittportAncr* 




nri Suptfnr|iibr« fnM 
thin out of 17 in 
i»porr«nct 



ranked thU our of 
17 In t«porUnc« 
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yhllMophv. OoaU. Styd^'nt Ht^* i -Jhc iic1m*o|. 
Km* 4 warklnt ttJitrfcent of phtloxophy wfilch 
!■ acc6«p«nted by iirhool «oalii and (ocu%r* on 
thr needs of ttudtnts. toth the ^tloM?phv .inJ 
goal! are coa^atlble with the overall rducatlB^Al 
phlloiophy aQd'pollcl%*t of tKc ichonl dUtrlc/. 
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tnitmctlonal Frotraa : The Inatrucrtoiwil pruKra« 



la In concert with the achool'a phllo«ophv anJ 
priority goals an4 aupH>rtcd by the ntaffl 



Principal AdalnUttrs* and Su^ervlaea : Th^ prin- 
cipal adalnls^rs Jnd supcrvliitfa the operation 
o* the scftool'r 



Written OArrlculy! There l» k vrlttsn cutrlculim 
which cofiulna ^nttructlonal objective for all 
levols and contant areas; * 



DIatnosIs aad Atulvslst Diagnosis and an-ilyHis of 

each student** ImMntf mmmA» tm -..^ 



each studanTs learning needs Is an Integral part 
of 'the Inatructlooal progtaa. 



Lraminf Actlvltlee Support Currlculuw ; Uarnlng 



actlvltlea <brrespond to the 'School goalw and- 
lust motional objectives of the currlculun. 



Staff Work s Totet^r ; The certified staff wotks 



together to laplaiiw tha Instructional progra» 
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Identification of Special Xtfeds/lntereh'tw ; The 



echool' 
of the 



prograa provides for thd ld«ntlf l<;atlon 
spaelal nledri and Interests* of 'stucVnti.. 



13 - 



Affective ?>edy! fhe'Vchool provides for th** 



affective natds of studenta/ 



10 



13 



10 



Frowotlon Ppllcv i' Thera is a written proootlun 



policy l^oparation which state* performance 
crlterl/Ttor assigning students to Instruct lon.iS 
levele and a plart for providing reaedlal ln«trutt Ion. 
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ClaasrocM Hanatement ; The uaigtfiae'nt of cUtfurooab. 



and other Inatructlmal arenk facilitates the 
acc^apllshsent of the school goal;; and object I vi>ii. 
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A pplication of Acquired Skill ; The prorraa prov|d»,< 
upFi'.-tunltles for application of ;icqulr«.d sV^lU, 
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in>j rquipwrnt nanafriynr * The itt.in.1K« TaMU 
la an^ equipment facilitates thv jritvo- 
of th^ school* I, goalMwand ob^rrt iv'i h. 



Supp!»a»nta r -' Protraa Cootdln.itt-d wllh »*'sular 
^togTAmi Suppti-»pntary prv^rjctf ar* well dfflnfd 
and ate coordinated with titv rt-gular lni(ttuctl«wtj| 
prograa. 



Hf/tlthy and Safe Bui Id I np, ^n«l Cround« ; Th». tiulldinK'* 
and Ktounda Are ■.ilnt.-ilmd and operated l« pruvidt* 
conditions which anr luaittiy .ind uafv. 



Parent Involvei'nt i The Mchool hai* a writttn 
policy for narent lnvnlvf»«.nt whirh Ik dliixtiiinjt«-it 
to all par^ta. 



Aldy^ and Voluntft»rH > A Idea und vuluntt*t*r>i .if 
tr'olnt'd, aMAljint'd .ind Ku{H<rvlf>*d. 
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and differences. Implications for revising the standards follow .each 
ahaiysls. * \ • " 

Similari ties Across Administrator Groups In the Ranking of Existing 
Standards. The first procedure was to determine whether there was. agree- 
ment between and within the three groups of administrators about xJhe ranking 
of the existing standards. It was assumed that if there was general agree- 
ment about the ranking of the existing standards, then the rest of the 
data from the other sections of the interview would be treated as one 

group. To determine agreement between and among groups on the ranked ' 

ft 

standards, Kendall's Coefficient of Concordance (W) was used (Siegel, l'956). 
This non-parametric statistical procedure was determined appropriate because 
there are K sets of rankings* (one for each i**terviewee)i of N otjects (the 17 
standards). "(lO expresses the degree of association among K such variables*' 
(Slegel, 1956, p. 229). Within groups there was moderate agreement on the 
ranking of the standards' at the .05 level of significance: Principal W«.44; 
Central Office W-.46; State Department W-.33. Between the three groups 
thBre was also moderate agreement at the .05 level of significance, 

The degree and the consistency of th^ rankings among all administrator 
groups are- heartening. All groups agreed!^ that the standards in the top seven 
ranks were important (see Figure 2); however, eafch group of administrators 
did rank them in slightly ^different orders. There was only one exception 
to that pattern in both top and bottom groups. It appear2d that the top seven 
standards provided a solid base froB which to condense the existing standards. 
Of particular Interest Is that prominence of the standard dealing with the 



philosophy of the school* Administrators recognize the importance of the 
school having a core of ideas and beliefs which help focus the instructional 
program, the management, and the staff functions of the school • 

. Of interest also is the degree of agreement on the standards ranked 
at the bottom: — mate^laL^nd^equlpmg nt management^ rsupplementary program 
coordination, safety, parent invplvement and aids and volunteers. The 
middle group of standards, deal with three areas: attention to student^^ 
needs and interests, application of skills, and management of classroom 
and- materials • . Consensus in this band is not as great as in the other 
bands* Because there was significant agreement among the three groups' of 
administrators, the rest of the data was analyzed as a whole, without 
reference to the three groups. 

Comparing Existing Standards with the 111 Statements . In order to 
provide an indication of whether the existing standards were congruent 
with the perceptions of Delaware school administrators, the 111 statements 
from the question, "What are the characteristics of an effective high school?" 
were^'grouped under the existing standards by one DPI and one RBS staff 
-member; ' \' 



Two issues which have ^recently received national prominence through 
federal legislation relating to Title I and P.L. 94-142' are parent involve- 
ment and mains treaming. Standards which encompass these concepts have 
relatively low importance to administrators when compared to the other 
standards* 
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The data suggest that the areas of the philosophy of the school, the 
school administration, and the school staff working together were congruent 
. with the general emphasis of Delaware school administrators. Moderate 
congruence was achieved in the area for the requirement for a written 
promotion policy and parent involvement. Areas not presently^ Included in 
the standards are listed at the bottom of the figi^v^ Statements dealing 
with instructional climate were relatively important to tiCe administrators 
but were not included in the existing standards. 

The results of this analysis suggest that those standards dealing with 
instruction may not hold as much importance for administrators. However, 
if the standards dealing with instruction are combined then parity is 
achieved with the standards on philosophy, administration and staff working 
together. A new standard on instructional climate Is also suggested from thi 
analysis. 

Comparing Existing Standards with the Four Major Categories Suggested 
from the Open-Ended Interviews . The four major categories derived from che 
interview's 111 statements were school focus, curriculum and instruction, 
leadership and school climate. Given that the existing standards only 
partially represented the administrators* perceptions of an effective 
sbhool (see Figure 3), the next analysis attempted to determine whether the 
four categories encompassed the existing standards. Figure 4 presents the. 
four categories on the left, the number of statements supporting that 
category in the middle, and the standards which could be subsumed under 
that category on the right. 



Figure 3 

Statements Congruent with Existing 
Standards from Open-^nded Interviews 

Congruent Statements with Existing 
Standards from Open-Ended Interviews 



Standard 

Philosophy, Goals, Student Needs 
Instructional Program Supports Philosophy 
■ Written Curriculum 

learning Activities Support Curriculum ^ 
Application of Acquired Skill 
Affective Needs 

4 . 
* - • «. 

Diagnosis and Analysis of Students' Learning Needs 
Prqmotion Policy 

Identl^cation of Special Needs/Interests 

Supplementary Program Coordinated with Regular Program 

ClassroomSlianagement 

Material and Equipment Management 



Principal Administers and Supervises 
staff Works Together 
Aides and Volunteers 
Parent Involvement 

Healthy and Safe Building and Grounds 

Other Statements Not Congruent with Existing Standards, 
Instructional Climate ^ 
Students' Reactions to School 
Athletic Program 

Behavior Code * 
Miscellaneous 



26 
0 

I 

3* 
0 
3 
4 
1 
8 
1 
4 
. 2 
0 
12 
14 
1 
5 
2 

7 
4 
2 

•3 
4 



Figure 4* 



Comparing Existing Standards with 
the 4 Major Categories Suggested from the Interviews 



Major Categories from 
Open-Tended Interview « 


No* of 

Statements 


Standards 


Focus 


26 


/ 

PhlloGophy, Goals, Student Needs 
Instructional Program 


Leadership 

« 


14 


Classroom Management 

Material and Equipment Management 

Principal Administers and Supervises 


Curriculum and 
Instruction 


21 


Written Curriculum 

Learning Activities Support Curriculum . 
Applicatio]^^ Acquired Skill 
Diagnosis aid Analysis 
Program Policy 

Identification of Special Needs/lnterests 
Supplementary Program Coordinated with 
Regular. Program 
Aides and Volunteers ' 


School Climate 


. < 25 


Affective Needs 
Staff Works Together 
Parent Involvement 

Healthy .and Safe Building and Grounds 



/' The chart indicates that the four categories have a relatively balanc^id 

;^ • . • 

distribution of responses from administrators compared to the distribution 
reported in Figure 3. This suggests that the existing standards could be 
condensed around the four categories" suggested in Figure 4. 
-Summary- of Results 

The Interview study found that there was a significant agreement from 
the three groups of administrators on the Importance of the following existing 
standards from the ranking cctlvlty: 




Philosophy, goals, student needs 
Instructional program 

Principal administers and supervises the school 

Written curriculum 

Diagnosis and analysis 

Learning activities support curriculum 

Staff works together 

A school focus or philosophy, the curriculum/instructional program, leader- 
. ship and the school climate appear to be .the major organizing ideas admlnl- 
stjrators use to describe effective high schools. 

•» < There was moderate , agreement Jbetween and among all groups Interviewed 
about the relative importance of the existing standards. Descriptions of 
effective high schools were for the-most part congruent with the existing 
jrtandards, although there, was emphasis on the following main Ideas: school 
focus and phllosophyf the principal's and staff 'V^amoftance and curriculum 
and instruction concerns were v.ery much present as indicators of an . 
effective high school in the open-ended interviews. In addition, 
effective high schools were usually described as having a positive school 
climate. There is presently no existing standard which deals with school 
climate. 

.\ The analysis suggests that the following changes might be made in 
the exi'st\lng standards o 

• The four categories of focus, leadership, curriculum, and instruction 
an^ school climate could be used to organize the existing standards; 

• Standards dealing with curriculum and instruction could be condensed 
to reflect principal's relative priorities. 

• Existing standards ranked near\the bottom may need to be dropped 
or combined with other standards. 

• A standard around school climate needs to be created to reflect 
administrator's perceptions. 
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^Jhe Interview Study as an Example . 
of Knowledge Utilization 

The domains of politics, research and professional experience each have 

something to contribute in the difficult proceed of designing and implementing 

policies to improve schools. The difficulty of merging these three world 

views is not to be underestimated. However, the extent that politics, research 

and professional experience are congruent may increase the likelihood of a 

successful school improvement program. This assumption is shown diagramatically 

below. 




The interview study was an attempt to use the systematic and objective 
Research methodology of the interview study to detejflnine the congruence between 
existing policy and professional experience and opinions of educational 
administrators. o - 

The interview study was -based on the assumption that if educational admini- 
aerators^ perceptions of effective schools were congruent and support the stand- 
ards, the resulting school improvement policy revision would be more likely to 
be successful. ^ 

^ . • / " - 
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Below Is a sequence of eveftts that describes the steps taken In ' 
revising the school^lmprovement standards. The length of time from the 
first to the last event Is nine months. This sequence provides a reference 
for discussing the lntervle;J study as an example of successful knowledge 
Utilization. ' 
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, figure 6 
Sequence ofxKvente In tevltlng 
School laprovesent Policy 

I«t«rvfw .tudy propo,.d by fsearchfor Utfv School.. (MS) »«flon.l 
Exchange <Rx). 

Director 41«c«»8e« It with DPI staff. 

Director propo««« etttdy to 9-12 AdvUory Council. 

Director •ppolntt DPI eupervleor to •••let In •tody deelgn. . 

DPI •upervlBor end MS lUt eteff •ember deelgn •tudy. 

DPI •upetvleor end MS Kx .teff Bember treln DPI Inter^lewr.. 

latervlewere conduct det« getherlng. ^ . . 

DPI eupervleor end MS Rx eteff «eirt.er conduct Initlel date enilyele.. 

DPI eupetrleor end MS Rx eteff .ember report Initial reaulte to. DPI - 
•upervleore - they try ^rtlng open-ended IntervleW etetemente. .■ 
teporte Initial reeulte to 9-12 Advleor Council - they try eortteg-open- 
ended Interview etetenente. - ^ 

final reeults reported to Division eteff. 

Director eppolnte three cooaltteea Involving everyone In Dlvlelon on 

the revlelon'of the atandards and monitoring vroceee. 
Director Invitee other MS eteff to work with three DPI eupervleore on 

developing echool climate atenderd. 
. Director report' ^-ilte of Dlvlalon'e work to 9-12 Advleory Council. 
Director erran. .etreet to treln other DPI .Uff In the revised echool 

ivproviiaent process. 



Knott and Wildavsky (1980) state. "Policy-makers are in the business 
of manipulating variables to produce desirable effects and avoid undesirable 
ones," (p. 427). Figure 7 describes seven standards of utilization which 
assesses whether a particular information was having an effect on policy- 
makers . 
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r Figure*'?^' 

Htm tUt4^H9 •f OfUlMtlM 

VtlUi.tloa UU. fUt. joXlty^kitt or .M.ow ttc.lvt jjjUty. 
flwaU oa tn MtlyttU <Mk or U xhm flUt of « <Ut«t tmuUM 

fin* VtlllMtlOCt it CMflttt. 

luw 4oM Kt MtilUAtlM liM eceurtW. 

■<. 

u!T;f.r«icttr«t hU mdnfUMnu of th. prob«bllltU. or ••gnltttdtt 

ftMM If wffrwMJt !• Iwporwnt bocftUM, U tho long inm, tho »oll^ 
MterU vov vUio« vlU shov U dlf'aroat ^licr yrlorltloa* 

To mU o rool 4iffsro«ci, InforMtlm mat Influooeo tin aetloQa of 
foUcr-iuiUra* If thoy fight for adoption of o atUjr'a foUey rtco»- 
. Wii4atleM. vo Inoir a rtaX affort vaa Mte If foUttcal foreaa or 
•tbor avoAU block it. ^ 

Wiftt la tJaoatial la wot vhothar rolicy-"!*****^ InfotMtloft la an 
iMot to tho folley yrocata* aoiia aay, bot irtitthar It ^ to In- 
Hwttca policy ottteoMO. Wley roaulta, oot Inyuta, la tka jropor 
•MiaH. 

«• ^Molo— otatlon 

Wlcy adoption la critical but. If a4ofta4 follcy tt*^' 
Uia, Infonatlon haa no chanca to affact action* Adortlon without 
iapIoMnUtloA la c hollow victory* 

A follcy nay b« lifloMnratf but faU to hava tha daalrad •'^•eta. 
|««ct It My bo (a«4 la) arg«ad that only vhtn policy atlwilatatl by 
infocmatlon yioia unglbla banaflu to tha dtittna U» utllUatlon 
tokon ylaca* 



The seven standards are hierarchically arranged so that the first must pre- 
ceed the next. For example, a pollcyrmaker must have "cognition" of Infor- 
nation' before a change In his/her "frame of reference" can take place. 
The seven standards will be used in this" paper as a framework for discussing 
how the interview research results described in the previous section were 
^Utilized. 



15 



20 



Reception 

In the reception stage, data reaches the policy-maker. Because of 
the way the interview study was designed, the policymakers in the state 
department were also the/ ones whc conducted the interviews. The initial 
findings and ensueing recommendations from the study were also rapor ted 
'during several division meetings. Thus, reception of the raw interview 
data was, in some ways, assured. 
Cognition 

In the cognition stage, policy-makers gain understanding of the^stu- 
-dies. While collection ''^of information, such as interviews, is a common 
practice in DPI, systematic aggregation of collected data from interviews 
1» tiot -as common. Thus, in order to build confidence in the conclusions 
of the study, and in order to build a consensus among the division staff, 
v-onc staff member and an RBS Rx staff member developed a systematic^ way to 
categorize the responses from the results of the question, ''What are the 
characteristics of an effective high school?" (see p. 3) Once the 111 
statements were decided on, then division staff and the 9-12 Principals 
Advisory Council had a chance to sort the cards in ways that made sense 
to each individual. This strategy insured "cognition," not only of the 
final results, but also about the way the re^tflts were generated. The 
final re9ults were reported, in meetings, of the division and the Principals 
Advisory Council.- ^ 
Refere nce 

Reference refers to a change in how a policy-maker sees the world « 
The standard of altering a policy-makerc's frame of reference is important 

/ 
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because of the possible consequence of a long-term change in policy priori- 
ties. Changes in frames of reference occurred on the part of DPI staff 
as. a result of the interview process and of division director's use of the - 
process. The Director's frame reference was confirmed and strengthened. 
To support these two conclusions some background information is necessary.^ 

State departments generally have two* major functions: 1) to monitor 
schools and districts to insure that funds are being disbursed properly, 
and 2) to insure that law and^^ode are being Implemented. Thus, the schools/ 
districts view the state as a "watch^g" at times and some state staff may 
view thvjns elves as enforcers of the laws and code. 

The school lmprovemi.^nt process was based on the state assisting schools 
lmproT7e> a role different from thot^e usually assumed by state agfencies* 
The standards and the school improvement process represent* both a minimiim 
expectation of the state and a process which individual schools can use to , 
look at themselves cace every five years to become effective within 
their own unique institutions^ For example, the firnt standard states that 
every school should have a working philosophy. This is assessed by whether 
the school 'has a philosophy in writing. In addition, the principal and 
key staff are asked to give the philosophy of the school. Similar responses ' 
indicate the presence of a wbrking philosophy. Thus, state department staff 
become "connoisseurs" of schools, savoring the school's flavor and reflecting 
on opportunities with school staff which, might lead to' school improvement.-^ 
*^(See Eisner (1979) for an Indepth look at '•connoisseurship.") For the , 
school improvement process in Delaware, compliance is not the issue. There 
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are no sanctions, such as removal of . accreditation, or rating of schools 

♦ 

as satisfactory or. unsatisfactory which 1« part of Delaware's School Improve- 
ment Process. The state staff's role Is much the samej function" as that of 
Internal auditors, except that state staff for school Improvement are not 
auditing spending procedures, but are sampling the quality of the school 
according to 'certain research-based standards (Squires, 1980). 

Now, the Director of Instruction, as part of his frame of reference, 
had the Idea that schools should be assisted In seeing reas where they,, 
could Improve; schools would not be assessed, graded, and labeled. Kot all of 
his staff understood or agreed with that point of View. In addition, cot 
many principals understood why the state department sent out yet another ^ 
team to "assess" schools. " , , 

Given this state of affairs within the Division, the division director 
used the Interview study to build consensus. His staff conducted most 
of the Interviews and compared notes on similarities and differences. DPI 
supervisors who at first were skeptical about thfe principals' abilities and 
motives for school Improvement,' began to change their perceptions after 
talking with principals. During staff meetings, DPI supervisors tried their 
hands at sorting the 111 statementsTnto groups.__These activities began 
to change the frames of reference within the department and external perception 
of the school improvsjient process byoprinclpals because of their involvement 
in the interviews. .'Because department staff interviewed the principals, they 
came .to a more complete understanding of the problems of secpnda^ principals 
in th'e state. The prin^ipala^^also reported that they found other school ' 



Improvement processes » such as middle states accreditation » a m?.anlngful 

way to look at, the total school, removed from the every day demands of 

maintaining an organization. Thus, the Director of Instruction used the 

interview results to change the^ frame of reference of intemaltand external 

constituents. In addition, the results of the study tended to reinforce 

his own point of view. Thus, the "reference" criteria for utilization 

♦ 

should also include confirming, as well as. changing, a policy-maker ^8 • 
frame of reference. .Both appear important. 

Effort 

This stage is charact*».rized by policy-makers influencing the actions of 
others and pushing- for recommendations. The Director of jnstruction, en- 
couraged by the results from the interviews, then committed each of his 
staff to work on the revision of the' standards. As one of^^the recommendations 
of the Interview study wds to inc3/ade a standard on school climate, as this 
had been one of the issues^ not -fcovered in the oi^iginal standards (see p*iO), 
a special task force was set up to address that issue. The results of the 
interviews,' as well as other types of research information now contained ^ 
in a sjmthesis of research on effective classrooms (Huitt and Segars, 1980) 

^ / 

and effective. schools (Squires, 1980), were used to condense and modify £he 
existing standards so' that they would more fully reflect the moot relevant 
.research available, the professional opinions of admlnstrators, and the ] 

assumption that ^nt state's role in scHool improvement vas to assist schools. . 

y - - * 

Thui; on the basis, of staff time,* an effort was made to see that the results 
of the interview study was adopted into policy. 
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Adoption . - 

The |(doptlon stage Is charectcii^ed by whether policy-relevant Infor- 
•atlon Is Incorporated! Into policy itself . The new standards and a reylsed 

process for school lir«>rovement were adopted. The new standards are summarlxed 

• V . . ^ ' \ 

below* • 

' Plgure 8 



Th« .chool Ub « .Mttd pMlotoph3r •cwnl.d br iichool rotl«. 

..." 

mum II ^ ^ - . . ' • . ■ 

rkm »thooX U» * 9lina*i profrajb .upported br 'tsff, th«t foU< 



iapro?«Mat« 

fTAHDAKD lit . - . * " 

Ite prl»clp«l «4plnl«t«r« •nd .upmrvls.. the ichooV* prosr«. - 

' Tliart ;ra vrlttw curricula t>imt tddrew the oin€ «ucaticnml Go«l« 
gt^gtS^ty STconUin lwtructloa.1 cbj.ctiv. for .U .ubjtct- 

fTAMPAia) y " . . ^ . 

frt/K«t MsessMot asid anilyif pf tfch .tiidwt'* n<«d. ar* lawl 
parts of Inatructlott. . ' ^ * 

STAKDA!tD rt * ' s ' / " ^. • 

• Uamlns actlTltlM tra dtalgnad to Kco«pll«H tha Inatructional 
^jactlvaa of; each cwlcujuu. • 

STAHPAIP VII ^ 

Tha aaoastacot of claaarooma and othar Instruction*! araaa fwUlUtea^ 
Icamiaa* 

PAID VI II * . • ^ 

Tha •cb^l cll«ata/al«>«ph€ra la conduclva to laamlns and poaltlva ' 
huaan Interaction* . • - 

ttAltPAItP U o ;5 

prograa* 

»ANPAia> X , ' ' 

Ihata la a urttt«i propotlon P-li<^/V^!i;^!S SJ^VSnd"^^^^^^ 
crltorla.for aaalgnlnt atudenta to Inatructlonal levels and incxuaea 
a plan for proYldlnt re^dlal Inatructlon. . ^ 

CTAWPAKO XI 

ixMli WHidbara are trained, aaaifnad. and supervised. 



Obviously, not all of the suggestions of the interview study were adopted- 
(see page^l2 for a summary). What .was adopted, however, was consistent with 
the recommendations that the^ standards be consolidated, and a new standard 
on school climate be developed, (see standard VIII) . Standard r on school • 
philosophy was simplified anc| retained its position. Standard III highlights 

the principal-* s leadership in the school. The number of standards dealing 

} 

with the instructional program was reduced. The state's educational goals 
* became integrated into" Standard IVr this had not been the casp in the 

previous set of > standards.' 

Overriding the whole of the fevisionAtdoptlon process was the idea that. 

the standards and the ^school* improvefcerit process should not be punitive, 
^ rather the process should foster schools using the data generated in the 

y . ' ' ' • ^ ' ^ 

schcK>l improvement process to make their own decisions about improvement 
opportunities. 

Implementation .< ^ . ^ ' V ^ 

In thi9 stage, ^ the policy Itselt is pnt Into practice. Staff from other 
divisions in. the state department were trained in the use of instruments 
and the. procedures for collecting data in schools during a thr^e-day DPI 
retreat. During the 1980-1981 school year, DPI school Improvement teams 
have visited schools. Thus, the policy was implemented. 
Impact / 

. . '1)13 the revised policy/practice actually improve schools^ At present,^ 

'it Is too early to tell. Reactions to the school inproveicent process from * 

is^cfiool principals have been favorable ac indicated by letters from principa,."* " 
' ' . • . •- 

.to 'the Director of Instruction. 
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Ittpllcations . and Conclusions . ^ ^ 

From this case study the seven standards of utilization wbicK Knott and 
Wlldavsicy propose are useful in assessing knowledge utilization in a policy 
revision process. It must be notc^d that the interview study was not designed 
with knowledge of Knott and Wlldavsky^s standards, although they appear to 

applicable to the inte^ew study a& an exercise of knowledge use affecting > 
.policy outcomes. It appears that it would be possible to plan a policy 
creation or r^yisipn effort explicitly using Knott and WiJdavsky^s standards. 
FOTthe? , the s tandards also istppear -to offer a f rMewor^wbich could, guide 

dcKifl&entatitm pirojects w]f^^^ is to have knowledge affect-policy. 

The- knowledge utilizaticm ^standards suggest various levels of knowledge 
use. Different levels may be appropriate for different, knowledge utilization 
effortd'* For example, one should expect that ERIC (Educatioiial Resources 
Information Center) might have a lower standard of knowledge utilization 
(perhaps at the cognition stage) than the Regional Exchanges* whose aim is 
to use research knowledge to effect policy adoption and implementation. 
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